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Abstract 

Background: No current validated survey instrument allows a comprehensive assessment of both physical activity and 
travel behaviours for use in interdisciplinary research on walking and cycling. This study reports on the test-retest reliability 
and validity of physical activity measures in the transport and physical activity questionnaire (TPAQ). 

Methods:lhe TPAQ assesses time spent in different domains of physical activity and using different modes of transport for 
five journey purposes. Test-retest reliability of eight physical activity summary variables was assessed using intra-class 
correlation coefficients (ICC) and Kappa scores for continuous and categorical variables respectively. In a separate study, the 
validity of three survey-reported physical activity summary variables was assessed by computing Spearman correlation 
coefficients using accelerometer-derived reference measures. The Bland-Altman technique was used to determine the 
absolute validity of survey-reported time spent in moderate-to-vigorous physical activity (MVPA). 

Results:\n the reliability study, ICC for time spent in different domains of physical activity ranged from fair to substantial for 
walking for transport (ICC = 0.59), cycling for transport (ICC = 0.61), walking for recreation (ICC = 0.48), cycling for recreation 
(ICC = 0.35), moderate leisure-time physical activity (ICC = 0.47), vigorous leisure-time physical activity (ICC = 0.63), and total 
physical activity (ICC = 0.56). The proportion of participants estimated to meet physical activity guidelines showed 
acceptable reliability (k = 0.60). In the validity study, comparison of survey-reported and accelerometer-derived time spent in 
physical activity showed strong agreement for vigorous physical activity (r = 0.72, p<0.001), fair but non-significant 
agreement for moderate physical activity (r = 0.24, p = 0.09) and fair agreement for IVIVPA (r = 0.27, p = 0.05). Bland-Altman 
analysis showed a mean overestimation of MVPA of 87.6 min/week (p = 0.02) (95% limits of agreement —447.1 to 
-1-622.3 min/week). 

Conclusion: Ihe TPAQ provides a more comprehensive assessment of physical activity and travel behaviours and may be 
suitable for wider use. Its physical activity summary measures have comparable reliability and validity to those of similar 
existing questionnaires. 
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Introduction 

Current approaches for increasing population levels of physical 
activity include promoting walking and cycling for transport and 
recreation. This has the potential to support policy goals in a 
number of sectors including public health (increasing physical 
activity levels), transport (increasing the use of sustainable travel 
modes) and environment (reducing carbon emissions) [1-3]. 



Increasingly, interdisciplinary research teams are working together 
to advance research in this area and require comprehensive 
measures of physical activity and travel behaviours to meet their 
dilTerent needs [3-5]. These measures need to enable assessment 
of the frequency and duration of participation in specific domains 
of physical activity, the total amount of physical activity 
undertaken, and the time spent and distance travelled using 
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different modes of motorised and non-motorised transport for 
specific journey purposes. To date, no such comprehensive 
instruments have been developed and tested for their reliability 
and validity. A few instruments do cover some of these items, but 
these generally omit certain domains of activity (such as 
recreational activity), journeys made for certain purposes or the 
use of modes of transport other than walking and cycling [6,7]. In 
some cases the use of modes of transport other than walking and 
cycling is measured but the modes are grouped collectively under 
the term 'motorised vehicles', as in the long version of the 
IntemationEil Physical Activity Questionnaire (IPAQ) [8]. This 
means it is not possible to assess the use of individual modes of 
motorised travel, such as car, train or bus, separately. 

The development of a comprehensive instrument presents a 
challenge because of differences in the measures and approaches 
used by c-ach discipline for assessing the different behaviours of 
interest. Physical activity research in adults typically uses self- 
report questionnaires or telephone surveys which ask about 
physical activity participation in different domains in the previous 
week or month [9] . The reliability and validity of instruments of 
this kind, such as the IPAQ [8], Global Physical Activity 
Questionnaire (GPAQ) [10] and Neighbourhood Physical Activity 
Questionnaire (NPAQ) [11], are usually tested and reported. 
However, in the transport sector, trip diaries and intercept surveys 
are more commonly used and the measurement properties of these 
instruments are often not tested or reported [1 2] . 

Although many physical activity questionnaires already exist 
and have been tested for reliability and vahdity, these instruments 
are often amended by researchers, who have slighdy differing 
needs for their specific research project, without further reliability 
and validity testing. The effect of making these small changes on 
reliability and validity is largely unknown which raises a question 
as to whether further reliability and validity studies are needed 
each time an existing survey is adapted or whether it is safe to 
assume that the measurement properties are likely to remain 
similar. 

The current study was conducted within the iConnect (Impact 
of constructing Non-motorised Networks and Evaluating Chang- 
es in Travel) project, a five year natural experimental study to 
assess the impact of improving walking and cycling infrastructure 
on travel, physical activity and carbon emissions [13]. In view of 
the lack of suitable existing instruments for assessing physical 
activity, walking and cycling for recreation, walking and cycling 
for transport and detailed measures of travel behaviour using other 
modes, a new transport and physical activity questionnaire 
(TPAQ) was developed. This paper reports on the development 
of the TPAQ, the test-retest reliability and validity of the physical 
activity items in the TPAQ^ and the impact of modifying an 
existing instrument, the IPAQ_ [8] . 

Methods 

Development and content of the TPAQ, The TPAQ_ was 
developed by an interdisciplinary consortium as part of the 
iConnect study in the UK. FuU details of the study, including a 
freely downloadable copy of the survey which incorporates the 
TPAQ, are provided elsewhere [14]. The development phase 
included a feasibility study [15] and pilot reliability and validity 
studies (not reported). The TPAQ was designed to enable a 
detailed assessment of time spent and distance travelled using 
different modes of transport overall and for different journey 
purposes, as well as time spent in different domains of recreational 
physical activity. First, travel behaviour in the last seven days was 
assessed across five categories of trip purpose: 1. to and from work. 



2. for business purposes, 3. to and from a place of study, 4. for 
shopping and personal business, and 5. to visit friends or family or 
for other social activities. For each journey purpose participants 
were asked to report the number of trips, the total time spent (in 
hours and minutes) and the total distance (in mUes) travelled in the 
last scv(;n days for each of six specified modes of transport 
(walking, cycling, bus, train, car as a driver and car as a passenger) 
or any 'other' mode (which captured modes such as taxi and van). 
Four domains of activity (walking for recreation, cycling for 
recreation, moderate leisure-time activity and vigorous leisure- 
time activity) were assessed using items adapted from the short 
form of the IPAQ [8] . The questions asked participants to report 
the number of sessions and the total duration of participation (in 
hours and minutes) in each of the four domains of activity in the 
last seven days excluding any activit)' they had previously reported. 
The items were then used to create a number of key physical 
activity summary variables (Table 1). In addition the survey asked 
respondents to report their sex, age, ethnic group, educational 
qualifications, housing tenure, and the number of cars and bicycles 
in the household. This paper reports on the refiability and vaUdity 
of the physical activity summary variables measured using the 
TPAQ. The reliability and validity of the travel behaviour 
measures will be reported separately. 

Ethics statement 

The reliability and validity studies received ethical approval 
from the University of Southampton Ethics Committee (CEE 
200809-15). 

Reliability study 

Participants and procedures. In October 2010, 3000 
adults were randomly selected from the edited electoral register 
for six wards in the town of Loughborough, UK and invited to 
complete the iConnect survey on two separate occasions, 
approximately seven days apart. The initial mailing contained a 
letter of invitation, a copy of the survey, a consent form and a 
freepost return envelope. Individuals who completed and returned 
the first survey (n = 2 1 6) were then posted the second sur\'ey and 
asked to complete and return it as soon as possible. Participants 
who (lid not return the second survey within seven days received a 
reminder phone call or letter. A prize draw to win one of twenty 
£25 gift vouchers was offered for those who completed both 
surveys as an incentive for participation. 

Physical activity summary variables. Seven continuous 
physical activity summary variables (number of minutes spent in 
the past week in walking for transport, cycling for transport, 
walking for recreation, cycling for recreation, moderate leisure- 
time physical activity, vigorous leisure-time physical activity and 
total physical activity) and one categorical variable (proportion 
meeting current UK physical activity guidelines) were computed. 
Time spent walking for transport for each of the five journey 
purposes was summed to give the total time spent walking for 
transport. A similar process was followed for total time spent 
cycfing for transport. A measure of total physical activity was 
computed by summing time spent walking and cycling for 
transport, time spent walking and cycling for recreation and time 
spent in moderate and vigorous leisure-time physical activity. This 
measure was also used to derive a categorical variable indicating 
whether respondents met the level of physical activity for adults 
recommended in the 2011 UK guidelines of at least 150 minutes 
of moderate intensity activity per week [16]. 

Analyses. The test-retest reliability of the seven continuous 
physical activity summary variables and the categorical variable 
was assessed. In secondary analyses, the refiability of the frequency 
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of participation (number of sessions per week) was assessed for 
walking for recreation, cycling for recreation, moderate leisure- 
time physical activity and vigorous leisure-time physical activity. 

Descriptive results are reported as mean ± standard deviation 
(SD). Intra-class correlation coefficients (ICC) were used to assess 
the reliability of each of the continuous variables and Kappa scores 
were used to assess the reliability of the categorical variable. For 
the purposes of this study, coefficient values of SO. 20 were taken 
to indicate poor agreement; 0.21-0.40 represented fair agreement; 
0.41-0.60 represented moderate or acceptable agreement; 
0.61-0.80 represented substantial agreement; and 0.81—1.0 
represented almost perfect agreement [17]. 

Validity study 

Participants and procedures. The validity study was 
conducted between June and October 2011. Participants who 
took part in the reliability study and who had agreed to take part 
in future studies (n = 1 36) were sent a letter inviting them to take 
part in the validity study. In addition, employees from Loughbor- 
ough University and three local small-to-medium-sized businesses 
were imited to take part in the project via email and word of 
mouth. 

Individuals who registered their interest in participating in the 
study were invited to attend a group meeting where they were 
provided with an accelerometer (Actigraph GT3X, Actigraph, 
Pensacola, Florida, USA), a global positioning system (GPS) data 
logger (QSTARZ BT-Q^IOOO) and a copy of the iConnect survey. 
A researcher explained the study to participants, including how to 
use the accelerometer and GPS device and when to complete the 
survey, and obtained written consent from each participant. 
Participants were instructed to wear the accelerometer and GPS 
device around their waist on the right hip for seven consecutive 
days from getting out of bed in the morning until going to bed at 
night, except when participating in water-based activities. Partic- 
ipants were asked to complete the survey on the eighth day. To 
maximise adherence to the study protocol, on the third day of 
monitoring participants received a follow-up telephone call or 
email to resolve any issues or concerns about the study. 
Participants were also contacted on day seven to remind them 
to complete the survey the following day and to arrange a time and 
place for the researcher to collect the study materials. Each 
participant in the validity study received a ^5 gift voucher. 

This study reports on the validity of the survey-derived physical 
activity summary variables using accelerometer data. GPS data 
were used only for the \ alidati()n of the travel behaviour measures, 
which will be reported separately. 

Data processing and accelerometer-derived physical 
activity summary variables. Accelerometers were pro- 
grammed to record data at ten second epochs. Raw accelerometer 
data were processed using MAHUflFe (MRC Epidemiology Unit, 
Cambridge, http:/ /www.mrc-epid.cam.ac.uk). The last day of 
recording (the day on which the accelerometer was collected from 
the participant) and continuous periods where 60 or more minutes 
of zero values were recorded were considered to be non-wear time 
and were excluded. To maximise study quality we applied a strict 
inclusion criterion whereby participants were only included in 
analyses if they had worn the accelerometer for six or more days 
for at least 10 hours per day and had completed the survey within 
2 days of their last day of accelerometry (n = 54). For participants 
with only six days of objectively measured physical activity (n = 9), 
the mean values for time spent in physical activity across the six 
recorded days were calculated and added to the six day total to 
estimate a value for seven days, the time period required for 
comparison with the survey data. Data were aggregated into 60 



second epochs and cut points were used to classify data into 
different intensity activities: sedentary (0-199 counts per minute 
(cpm)), hght intensity activity (200-2019 cpm), moderate intensity 
activity (2020-5998 cpm), or vigorous/very vigorous intensity 
activity (>5998 cpm) [18,19]. Summary variables were then 
computed representing time spent in moderate physical activity; 
time spent in vigorous physical activity (includes vigorous/very 
vigorous intensity activity) and time spent in moderate-to-vigorous 
physical activity (MVPA) (sum of time spent in moderate and 
vigorous physical activity). 

Survey-derived physical activity summary 

variables. Three physical activity summary variables (moderate 
physical activity, vigorous physical activity and MVPA) were 
computed using survey data for comparison with accelerometer 
data. Times spent walking for transport, walking for recreation 
and in moderate leisure-time physical activity were summed to 
give time spent in moderate physical activity. Self-reported time 
spent in vigorous leisure-time physical activity was used for 
comparison with accelerometer-derived time spent in vigorous 
activity. A measure of total MVPA was computed by summing 
time spent walking for transport, time spent walking for recreation 
and time spent in moderate and vigorous leisure-time physical 
activity. Cycling was excluded from the survey-derived physical 
activity summary variables used in the validity study because hip- 
worn accelerometers have limited capacity to detect cycling [20] 
and time spent cycling has been shown to be a significant 
contributor to the disagreement between self-reported and 
objectively measured estimates of activity [21]. A sensitivity 
analysis was, however, conducted to determine whether this had 
any impact on the results (see below). 

Analyses. Descriptive statistics are reported as mean ± 
standard deviation (SD). Correlation coefficients were calculated 
for survey-reported and accelerometer-derived summary physical 
activity variables using Spearman's rho because the data were not 
normally distributed. 

Absolute validity was assessed by determining the agreement 
between self-reported toted time spent in MVPA and accelerom- 
eter-derived total time spent in MVPA using the Bland-Altman 
technique [22]. A mean bias was defined as a significant mean 
difference obtained by subtracting <)l)j(;rtively measured time spent 
in physical activity from self-reported time spent in physical 
activity. The error was defined as 2 SD of the mean bias. 

Analyses for the reliability and vafidity studies were conducted 
using Statistical Package of Social Sciences, version 19.0.0 for 
Windows (IBM SPSS Inc, Chicago, lUinois, USA). Bland-Altman 
analyses were conducted using STATA 1 3 (StataCorp LP, College 
Station, Texas, USA). 

Sensitivity analysis. A sensitivity analysis was conducted to 
determine the impact of including cycling in the survey-derived 
data for the analyses. Additionally, because participants may have 
reported transport or recreational walking undertaken at light 
intensity (<3 METs) [23] we conducted a second sensitivity 
analysis in which time spent in objectively-measured Ught intensity 
activity was included in the accelerometer-derived summary 
variables for total physical activity and moderate intensity physical 
activity. For both analyses, correlation co-efficients were calculated 
and absolute validity was assessed. 

Results 

Reliability study 

Of the 3000 adults invited to take part in the reliability study, 
166 completed and returned both surveys (a response rate of 6%) 
and were included in the analysis (Table 2). 
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Table 2. Sample characteristics. 





Characteristic 




Reliability study 


Validity study 






n = 166 




n = 54' 








n" 


% 


n" 


% 


Sex 


Male 


77 


46.7 


19 


35.2 


Age (years) 


<30 


19 


11.7 


12 


22.2 




30-44 


40 


24.5 


13 


24.1 




45-64 


59 


36.2 


25 


46.3 




>65 


45 


27.6 


4 


7.4 


Ethnicity 


White 


147 


90.7 


53 


98.1 




Other 


15 


9.3 


1 


1.9 


Education 


Degree 


51 


31.7 


35 


64.8 




GCE 'A' Level 


28 


17.4 


10 


18.5 




GCSE Grades A to C 


39 


24.2 


5 


9.3 




No formal qualification 


43 


26.7 


4 


7.4 


Housing tenure 


Owned 


1 33 


81.1 


44 


81 .5 




Rented from private landlord 


10 


6.1 


9 


16.7 




Rented from local authority 


19 


11.6 


1 


1.9 




Other 


2 


1.2 


0 


0.0 


Household cars 


0 


20 


12.3 


6 


11.1 




1 


71 


43.8 


18 


33.3 




2 or more 


71 


43.8 


30 


55.6 


Household bicycles 


0 


57 


34.3 


7 


13.0 




1 more 


109 


65.7 


47 


87.0 



^ Included in analysis. 

^ Numbers do not sum to totals due to missing responses. 
doi:1 0.1 371 /journal.pone.Ol 07039.t002 



For each of the physical activity summary variables the mean 
weekly duration of physical activity was lower at the second survey 
administration (T2), which took place on average 12.4±6.6 days 
after the first survey administration (Tl) (Table 3). The reliability 
of the survey-based time measures differed according to the 
specific activities being assessed. For transport-related activity, the 
intra-class correlation (ICC) of items was substantial for time spent 
cycling for transport (ICC = 0.61) and acceptable for time spent 
walking for transport (ICC = 0.59). For recreational activities, 
there was acceptable agreement for time spent walking for 
recreation (ICC = 0.48) but only fair agreement for time spent 
cycling for recreation (ICC = 0.35). Agreement was substantial for 
time spent in vigorous leisure-time physical activity (ICC = 0.63) 
and acceptable for time spent in moderate leisure-time intensity 
physical activity (ICC = 0.47) (Table 3). There was acceptable 
agreement between the two survey administrations for total 
duration of physical activity (ICC = 0.56) (Table 3) and for the 
proportion of respondents meeting physical activity recommen- 
dations (Kappa = 0.60) (data not shown). 

For frequency of participation, there was substantial agreement 
for the number of sessions of walking (ICC = 0.80) and cycling 
(ICC = 0.63) for recreation, acceptable agreement for the number 
of sessions of vigorous intensity leisure-time physical activity 
(ICC = 0.52) and poor agreement for the number of sessions of 
moderate intensity leisure-time physical activity (ICC = 0.13) 
(Table 4). 



Validity study 

A total of 72 participants took part in the vahdity study. These 
were recruited from among those who took part in the reliability 
study (n = 25; a response rate of 18%) and from the convenience 
samples of staff and students of Loughborough University (n = 27) 
and local small-to-medium-sized businesses (n = 20). Of those who 
took part in the validity study 54 participants were eligible for 
inclusion in the analysis (Table 2). 

In comparison to objectively-measured data, participants 
tended to over-report moderate and vigorous physical activity 
which resulted in an over-reporting of total physical activity in the 
survey (Table 5). Survey-reported moderate physical activity 
(including moderate leisure-time physical activity, walking for 
transport and walking for recreation, but excluding any cycling) 
showed fair agreement with objectively measured time spent in 
moderate physical activity (r = 0.24, p = 0.085). In contrast, 
survey-reported vigorous physical activity showed strong agree- 
ment with objectively-measured vigorous physical activity 
(r = 0.72, p<0.001), although this relatively high correlation 
concealed large differences in the absolute estimates in that the 
mean duration of survey-reported vigorous physical activity 
(99.2 mill/week) was more than three times higher than that of 
objectively-measured vigorous physical activity (30.2 min/week). 
Agreement between survey-reported MVPA and objectively- 
measured MVPA was fair and of borderline statistical significance 
(r = 0.27, p = 0.051) (Table 5). 

In sensitivity analysis, including light intensity activity in the 
accelerometer-derived summary variables reduced the agreement 
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Table 3. Intra-class correlations for time spent in transport-related and recreational physical activity overall and by domain. 





Physical activity domain 




T1 


T2 






n 


Mean minutes in last week +SD Mean minutes in last week +SD 


ICC (95% CI) 


Walking for transport 


164 


142.0±256.6 


129.6 ±194.4 


0.59 (0.48, 0.68) 


Cycling for transport 


164 


25.7±92.6 


21.5±92.6 


0.61 (0.50, 0.70) 


Walking for recreation 


165 


11 7.1 ±192.2 


116.6±207.4 


0.48 (0.35, 0.59) 


Cycling for recreation 


165 


27.4± 104.6 


20.4± 105.8 


0.35 (0.20, 0.47) 


Moderate intensity leisure-time physical activity 


165 


80.7 ±168.4 


63.2±131.8 


0.47 (0.34, 0.58) 


Vigorous intensity leisure-time physical activity 


163 


60.6± 134.2 


49.8±97.1 


0.63 (0.53, 0.71) 


Total physical activity^ 


161 


441 .2 ±455.3 


387.4±374.0 


0.56 (0.45, 0.66) 


T1 = Survey time point 1; 
T2 = Survey time point 2; 

^Total physical activity includes vigorous and moderate leisure-time activity and walking 


and cycling for transport and recreation. 





doi:1 0.1 371 /journal.pone.Ol 07039.t003 



between self-reported and objectively-measured moderate physical 
activity (r = 0.17, p = 0.226) whereas the agreement for MVPA 
improved slightly and became significant (r = 0.29, p = 0.037). 
Including cycling in the survey-derived summary variables 
reduced the agreement between survey-reported and objectively- 
measured moderate physical activity (r = 0.10, p = 0.495) and 
between survey-reported and objectively-measured MVPA 
(r = 0.09, p = 0.5 18) (data not shown). 

A Bland- Altman plot for the main analysis is shown in Figure 1 . 
The difference between self-reported and accelerometer-derived 
MVPA for each participant is plotted on the 31 axis against their 
accelerometer-derived MVPA on the x axis. A mean overestima- 
tion of self-reported MVPA of 87.6 min/week (p = 0.02) was 
observed and the 95% limits of agreement were wide (—447.1 to 
-H622.3 min/week). 

In sensitivity analysis including light intensity accelerometer 
activity, the mean difference was greater at —1407.5 min/week 
(p<0.001) with commensurately wider 95% limits of agreement 
(—2314.4 to —500.6 min/week). In sensitivity analysis including 
cycling for transport and recreation in survey-reported total 
physical activity, the mean diflFerence was 202.4 min/week (p< 
0.001) with 95% limits of agreement of -473.6 to -H878.3 min/ 
week (data not shown). 

Discussion 

A new instrument (the TPAQ) was developed for use in 
interdisciplinary research on physical activity and travel behav- 
iours. The instrument allows specific target behaviours (walking 
and cycling separately and for different purposes) to be measured 



as well as providing an estimate of total physical activity. 
Developing such instruments is challenging given the different 
approaches typically used by different disciplines to assess the 
behaviours of interest and diflFerences in terminology applied to 
similar constructs. 

Reliability and validity of physical activity summary 
variables derived from TPAQ 

TPAQ, which combines new items on travel behaviour with an 
adapted version of the short form of IPAQ appears to be an 
acceptably reliable measure of time spent in different domains of 
physical activity as well as total physical activity. In most respects 
its reliability was comparable to that of other similar instruments 
used for measuring physical activity [8,10,11,24,25]. We used the 
last seven days as the reference period, which may have resulted in 
lower stability in our measures of behaviours such as walking and 
cycling for transport and recreation than would have been 
observed using an instrument framed in terms of a 'usual' week. 

The reported frequency of participation in most types of leisure- 
time physical activity (walking for recreation, cycling for recreation 
and vigorous intensity physical activity) showed greater reliability 
than that for the reported duration of activity. Similar findings 
have been reported elsewhere [1 1], raising the question of whether 
it may be more appropriate to assess frequency of participation 
than to assess duration. However, the test-retest reliability of 
reported frequency of moderate intensity physical activity was 
poor, and it is more difficult to impute health benefits to a measure 
of frequency of participation than to an estimate of total volume 
(e.g. duration) of activity. 



Table 4. Intra-class correlations for frequency of participation in recreational physical activity. 



Physical activity domain 





n 


Mean times in last week (±SD) 


Mean times in last week (±SD) 


ICC (95% CI) 


Walking for recreation 


165 


2.6±4.2 


2.4±4.1 


0.80 (0.73, 0.85) 


Cycling for recreation 


165 


0.4±1.3 


0.4±1.2 


0.63 (0.53, 0.71) 


Vloderate intensity leisure-time physical activity 


166 


1.0±1.7 


0.8 ±2.4 


0.13 (-0.02, 0.28) 


Vigorous intensity leisure-time physical activity 


166 


1.1±1.9 


0.9 ±1.8 


0.52 (0.40, 0.62) 



Tl = Survey time point 1; 
T2 = Survey time point 2. 
doi:l 0.1 371/journal.pone.Ol 07039.t004 
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Measured total MVPA {min/week) 



Figure 1. Bland-Altman plot for time spent in moderate-to- 
vigorous physical activity. The difference between objectively 
measured time spent in total MVPA (min/week) and self-reported time 
spent in MVPA excluding cycling (min/week) plotted against objectively 
measured time spent in MVPA (min/week). Mean difference: 87.6 min/ 
week (p = 0.02); limits of agreement: -447.1 min/week, +622.3 min/ 
week. 

doi:10.1 371/journal.pone.01 07039.g001 

Compared to an accelerometer-derived criterion, TPAQ^ 
produced an estimate of total time spent in physical activity of 
comparable validity to that of the short IPAQ^ [8,25] and most 
other off-the-shelf questionnaires of similar length currently in use. 
In Bland-Altman analysis, TPAQ, significandy overestimated 
MVPA in comparison to accelerometer-derived estimates by 
88 minutes per week, with no clear pattern of any change in bias 
with higher levels of self-reported physical activity. Other studies 
have also reported an overestimation of self-reported MVPA in 
comparison to accelerometer-measured MVPA, although these 
differences have been much larger than those observed in our 
study. For example, one recent study found an overestimation of 
46 minutes per day between GPAQ^ and objectively-measured 
MVPA, and 76 minutes per day between short IPAQ^ and 
objectively-measured MVPA [26] . The observed limits of agree- 
ment in our study were very wide (over 10 hours per week) 
however other studies comparing self-reported MVPA with 
objectively-measured MVPA have reported even larger limits of 
agreement, for example up to 17 hours per week using long IPAQ^ 
[27] or two hours per day using short IPAQ, [28]. We therefore 
conclude that TPAQ^is as acceptable as other similar instruments 
for use in measuring MVPA, notwithstanding the widely 
recognised limitations of all self-reported estimates of physical 
activity. 

The substantial agreement observed for vigorous physical 
activity estimated using the TPAQ, is higher than that reported 
elsewhere [25]. However it appears that the TPAQ, may 
overestimate the time spent in this domain of activity and thus 
overall physical activity. The poor agreement between survey- 
reported and accelerometer-measured moderate physical activity 
has also been observed in a number of other studies [25]. This may 
reflect participants having reported light intensity activities in the 
survey, as TPAQ^ does not specify the intensity of walking and 
cycling for transport or recreation that should be reported. 
Participants may therefore have reported walking or cycling of any 
intensity. Including light intensity accelerometer-derived activity in 
a sensitivity analysis did improve the agreement slightly for total 
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physical activity. These findings suggest that the performance of 
TPAQ_ as a measure of moderate and vigorous physical activity 
could be improved by specifying the intensity of walking and 
cycling that should be reported and more clearly defining which 
activities should be reported as being of vigorous intensity. The 
inclusion of cycling in survey-reported measures reduced the 
agreement with accelerometer-derived variables, supporting pre- 
vious findings that time spent cycling may contribute to the 
disagreement between self-reported and objectively measured 
estimates of activity [21]. 

TPAQ, asks about participation in a number of different 
domains of physical activity in order to provide more specific 
outcome measures for particular interventions that might target, 
for example, walking or cycUng for transport or recreation. In the 
validity study, this appeared to lead to an over-reporting of 
physical activity compared to accelerometer-derived estimates. It is 
not yet clear whether disaggregating physical activity behaviours in 
this way leads to over-reporting, or whether it increases accuracy 
because participants can recall the time they have spent in more 
specific activities more precisely than they can provide a more 
global estimate of time spent in overall physical activity. Other 
possible reasons for the higher estimates from self-report data 
include social desirability bias which may have led to participants 
over-reporting their activity; difficulties in recalling activities over 
the past week; inclusion of short (<10 minute) bouts of activity; or 
the need for participants to sum time spent in different activities 
over the previous week. High estimates may also be due to 
participants reporting walking or cycling under both 'transport' 
and 'recreation, health or fitness' headings, because it is sometimes 
difficult to distinguish these purposes. 

Adaptation of physical activity items from existing 
instruments 

Instruments used to assess physical activity behaviour are often 
adapted by investigators for use in their research projects without 
further reliability and validity testing. In developing the TPAQ, 
recreational and leisure-time physical activity items were adapted 
from an existing instrument, the short IPAQ. We found the 
physical activity summary variables derived from TPAQ to have 
broadly comparable reliability and validity to those of the original 
IPAQ [8], suggesting that minor modifications to survey 
instruments may not necessarily alter their reliability and validity 
to the extent that their measurement properties would always need 
to be reassessed. However, IPAQ^ itself has been tested in a large 
number of different populations from different countries [8,9,25] 
with varying findings, suggesting that it is not only the wording of 
the surveys but also the target group and context in which they are 
used that may affect reliability and validity. 

Strengths and limitations 

We successfully developed an instrument to meet the needs of 
interdisciplinary research on physical activity and travel behav- 
iour. We tested its reliability and validity predomrnantiy using a 
community sample rather than a convenience sample, which helps 
to improve the generaUsabUity of our findings. Although the 
response rate to the reliability study was low, our sample had a 
similar gender and ethnic composition to that of the 201 1 Census 
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findings [29] for the local borough of Charnwood from which our 
sample was recruited. There was a small difference in age 
distribution, with a lower proportion of those aged under 30 and a 

higher proportion of those aged over 45 represented in our 
sample. In the validity study additional strategies were necessary to 
recruit sufficient participants, resulting in the inclusion of staff and 
students from within the University and local workplaces that may 
have reduced the overall representativeness of the study popula- 
tion. 

Adherence with the validity study protocol was generally very 
high, although a small number of participants did not wear the 
accelerometer for sufficient time on all seven days of the 
measurement period. We were able to adjust for this in the 
analysis using standard procedures. Some participants were 
excluded from the analysis because they did not meet the strict 
accelerometer wear time criteria or did not complete the survey 
with two days of their final day of wearing the accelerometer. 
There were no significant differences in key characteristics 
between participants included and excluded for these reasons, 
except that a higher proportion of those excluded were aged 30-44 
(data not shown). Given the low number of participants in the 
vahdity study, and the inclusion of only a small number of adults 
aged 65 and over, further investigation may be required to assess 
the measurement properties of the TPAQ in different age groups 
and in different contexts. 

Finally, it is difficult to distinguish between different forms of 
activity using conventional methods of processing accelerometer 
data, and it was therefore not possible to assess the validity of self- 
reported estimates of time spent in the specific behaviours of 
walking and t:ycling in this study. To derive objective measures of 
mode-specific travel times in this sample requires a combination of 
accelerometer and GPS data that will be pursued in subsequent 
analyses. 

Conclusions 

This study reports on the development and selected measure- 
ment properties of a new comprehensive instrument (the TPAQ) 
for use in the assessment of physical activity and travel behaviours. 
Overall, the reliability and validity of the TPAQ^ for measuring 
total physical activity, and specific domains of physical activity 
including walking and cycling for different purposes, are compa- 
rable to those of existing physical activity questionnaires of similar 
length currendy being used. The TPAQ^may therefore provide an 
alternative instrument suitable for wider use. 

Acknowledgments 

Tfiis paper was written on behalf of the iConnect consortium (www. 
iconnect.ac.uk: Christian Brand, Fiona Bull, Ashley Cooper, Andy Day, 
Nanette Mutrie, David Ogilvie, Jane Powell, John Preston and Harry 
Rutter). We thank the study participants for their cooperation and Aion 
Sherry for co-ordinating the reliability study. 

Author Contributions 

Concci\'cd and designed the ("xporiniciils: EA SS FB AC DO. Performed 
the experiments: EA MG. Analyzed the data: EA MG SS AC DO. Wrote 
the paper: EA MG SS FB AC DO. 



2. de Nazelle A, Nieiiwenhuijsen .\1J, Anto J.\l, Brauer .\1. Briggs D, et al. (201 1) 
Improving health through policies that promote active travel: A review of 
evidence to support integrated health impact assessment. Environ Int 37: 766- 
777. 



PLOS ONE I www.plosone.org 



8 



September 2014 | Volume 9 | Issue 9 | el 07039 



Transport and Physical Activity Questionnaire Reliability and Validity 



3. National Institute for Health and CJarc ExccUrncc (2012) Walking and cycling: 
Local measures to promote walking and cycling as forms of travel or recreation. 
NICE Public Health Guidance 41. 

4. Handy SL, Boamet MG, Ewing R, Killingsworth RE (2002) How the built 
environment affects physical activity - views from urban planning. Am J Prev 
Med 23: 64-73. 

5. Krizck KJ, Handy SL, Forsyth A (2009) Explaining changes in walking and 
bicycling behaviour: Challenges for transportation research. Environ Plann B 

36: 725-740. 

6. Badland H, Schofirld G (2006) Test-rctest reliability of a survey to measure 
transport-related physical activity in adults. Res Q_Exerc Sport 77: 386 390. 

7. Forsyth A, Agrawal AW, Krizek KJ (2012) Simple, inexpensixc approach to 
sampling for pedestrian and bicycle surveys approach developed in pixk-strian 
and bicycling sur\'ey. Transp Res Rec 2299: 22—30. 

8. Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, ct al. (2003) 
International Physical Activity 0_iirstionnaire: 12-countr\' reliability' and validitv. 
Med Sci Sports Exere 35: 1381 1395. 

9. van Poppel MNM, C:hinapa\v MJM, Mokkink LB, \'an Mechelen W, Terwee 
CB (2010) Physical acii\ii\ questionnaires for adults A systematic review of 
measurement properties. Sports Med 40: 565-600. 

10. Bull FC, Maslin TS, Armstrong T (2009) Global Physical Activity Questionnaire 
(GPAQ): Nine country reliability and validity study. J Phys Act Health 6: 790- 
804. 

11. Giles-Corti B, Timpcrio A, Cutt H, Pikora TJ, Bull FCL, ct al. (2006) 
Development of a reliable measure of walking within and outside the local 
neighborhood: RESIDE's neighborhood physical activity questionnaire. Prev 
Med 42: 455-1-59. 

12. Forsyth A, Krizek KJ, Agrawal AW (2010) Measuring walking and cycling using 
the PABS (pedestrian and bicycling survey) approach: A low-cost survey method 
for local communities. CA-MTI-10-2907. 

13. Ogilvie D, Bull F, PoweU J, Cooper AR, Brand C, et al. (2011) An appHed 

ecological framework for evaluating infrastructure to promote walking and 
cycling: The iConnect study. AmJ Public Health 101: 473-481. 

14. Ogilvie D, Bull F, Cooper A, Rutter H, Adams E, et al. (2012) Evaluating the 
travel, physical activity and carbon impacts of a 'natural experiment' in the 
provision of new walking and cycling infrastructure: Methods for the core 
module of the iConnect study. BMJ Open 2: e000694. 

15. Sahlqvist S, Song Y, Bull F, Adams E, Preston J, et al. (2011) Effect of 
questionnaire length, personahsation and reminder type on response rate to a 
complex postal survey: Randomised controlled trial. BMC Med Res Methodol 
11: 62-62. 

16. Department of Health (2011) Start Active, Stay Active: A report on physical 
activity from the four home countries' Chief Medical Officers. London, UK. 



Available: https:/ /www. gov.uk/government/publieations/ s tart -act ive-stay- 
active-a-report-on-phvsieal-aetivity-from-the-fbur-home-countrics-chief- 
medical-officers. Accessed 2014 Aug 25. 

17. LandisJR, Koch GG (1977) Measurement of observer agreement for categorical 
data. Biometrics 33: 159-174. 

18. Craig R, MindeUJ, Hirani V (2009) Health Survey for England 2008 Volume 1. 
Physical activity and fitness. NHS Information Centre for Health and Social 
Care. London, UK. 

19. Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, et al. (2008) Physical 
activity in the United States measured by accelerometer. Med Sci Sports Exerc 

40: 181-188. 

20. De Vrirs SI, Engels M, Ciarre VG (201 1) Identification of children's aeti\'ity type 
with aeccleromeler-based neural networks. Med Sci Sports Exere 43: 1994- 
1999. 

2 1 . Slootmaker SM, Sehuit AJ, Chinapaw MJM, Seidell JC, van Mechelen W (2009) 
Disagreement in physical activity assessed by accelerometer and self-report in 
subgroups of age, gender, education and weight status. Int J Behav Nutr Phys 
Act 6: 17. 

22. Bland JM, Altman DG (2010) Statistical methods for assessing agreement 
between two methods of clinical measurement. Int J Nurs Stud 47: 931—936. 

23. Ainsworth BE, Haskell WL, Herrmann SD, Meekes N, Bassett DR Jr, et al. 
(2011) 2011 compendium of physical activities: A second update of codes and 
MET values. Med Sei Sports Exere 43: 1575-1581. 

24. Helmerhorst HJE, Brage S, Warren J, Besson H, Ekclund U (2012) A systematic 
review of reliability and objecti\'e criterion-related vahdity of physical activity 
questionnaires. Int J Behav Nutr Phys Act 9: 103. 

25. Lee PH, Macfarlane DJ, Lam TH, Stewart SM (2011) Validity of the 
International Physical Activity Questionnaire short form (IPAQ-SF): A 
systematic review. Int J Behav Nutr Phys Act 8: 115. 

26. Herrmann SD, Heumann KJ, Der Ananian CA, Ainsworth BE (2013) Validity 
and reliability of the Global Physical Activity Questionnaire (GPAQ). Meas Phys 
Educ Exerc Sci 17: 221-235. 

27. Hagstromer M, Oja P, Sjostrom M (2006) The International Physical Activity 
Questionnaire (IPAQ): A study of concurrent and construct validity. Public 
Health Nutr 9: 755-762. 

28. Ekelund U, Sepp H, Brage S, Becker W, Jakes R, et al. !2006;i Oiterion-related 
validity of the last 7-day, short form of the International Physical Activity 
Questionnaire in Swedish adults. Public Health Nutr 9: 258-265. 

29. Office for National Statistics (2011) 2011 Census for England and Wales. 
Available: http:/ / www.ons.gov.uk/ ons/ guide-method/ census/ 20 1 1 /index, 
html?utm_source=twitterfeed&utm_medium=twitter. Accessed 2014 Aug 25. 



PLCS ONE I www.plosone.org 



9 



September 2014 | Volume 9 | Issue 9 | e107039 



